Multi-Job Intelligent Scheduling With Cross-Device Federated Learning
نویسندگان
چکیده
Recent years have witnessed a large amount of decentralized data in various (edge) devices end-users, while the aggregation remains complicated for machine learning jobs because regulations and laws. As practical approach to handling data, Federated Learning (FL) enables collaborative global model training without sharing sensitive raw data. The servers schedule within process FL. In contrast, device scheduling with multiple FL critical open problem. this article, we propose novel multi-job framework, which parallel. framework is composed system method. parallel jobs, cost based on fairness time diverse during process. We intelligent methods, including an original reinforcement learning-based method Bayesian optimization-based method, corresponds small jobs. conduct extensive experimentation datasets. experimental results reveal that our proposed approaches significantly outperform baseline terms (up 12.73 times faster) accuracy 46.4% higher).
منابع مشابه
Solving Flexible Job Shop Scheduling with Multi Objective Approach
In this paper flexible job-shop scheduling problem (FJSP) is studied in the case of optimizing different contradictory objectives consisting of: (1) minimizing makespan, (2) minimizing total workload, and (3) minimizing workload of the most loaded machine. As the problem belongs to the class of NP-Hard problems, a new hybrid genetic algorithm is proposed to obtain a large set of Pareto-optima...
متن کاملDeep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling
Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The traditional solution is to design efficient heuristic algorithms with performance guarantee under certain assumptions. In this paper, we improve a recently proposed ...
متن کاملFederated Multi-Task Learning
Federated learning poses new statistical and systems challenges in training machinelearning models over distributed networks of devices. In this work, we show thatmulti-task learning is naturally suited to handle the statistical challenges of thissetting, and propose a novel systems-aware optimization method, MOCHA, that isrobust to practical systems issues. Our method and theor...
متن کاملMulti-Task Learning for Straggler Avoiding Predictive Job Scheduling
Parallel processing frameworks (Dean and Ghemawat, 2004) accelerate jobs by breaking them into tasks that execute in parallel. However, slow running or straggler tasks can run up to 8 times slower than the median task on a production cluster (Ananthanarayanan et al., 2013), leading to delayed job completion and inefficient use of resources. Existing straggler mitigation techniques wait to detec...
متن کاملIntelligent Backtracking Techniques for Job Shop Scheduling
This paper studies a version of the job shop scheduling problem in which some operations have to be scheduled within non-relaxable time windows (i.e. earliest/latest possible start time windows). This problem is a wellknown NP-complete Constraint Satisfaction Problem (CSP). A popular method for solving these types of problems consists in using depthrst backtrack search. Our earlier work focused...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Parallel and Distributed Systems
سال: 2023
ISSN: ['1045-9219', '1558-2183', '2161-9883']
DOI: https://doi.org/10.1109/tpds.2022.3224941